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A.l Determination of /c(d) E) from . 

The thermodynamics for a system with given temperature, density, and volume i 
scribed by the Canonical ensemble. The thermodynamics for a corresponding system with 
the same temperature, volume, and average density is described by the Grand Canonical 
ensemble. In general a chosen thermodynamic potential (e.g., free energy) is different 
in the two cases. Their relationship is considered here as a function of the system size. 
Exact expressions relating the fundamental potential for each (free energy and pressure, 
respectively) are identihed for arbitrary system size. A formal asymptotic analysis for 
large system size gives the expected equivalence, but without any characterization of the 
intermediate size dependence. More detailed evaluation is provided for the simple case 
of a homogeneous, non-interacting Fermi gas. In this case, the origin of size dependence 
arises from only two length scales, the average inter-particle distance and quantum length 
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scale (thermal deBroglie or Fermi length). The free energies per particle calculated from 
each ensemble are compared for particle numbers 2 < < 64 for a range of temperatures 

above and below the Fermi temperature. The relevance of these results for applications 
of density functional theory is discussed briefly. 

Keywords: Grand Canonical ensemble, Canonical ensemble, System-size Dependence, 
Free energy. Homogeneous Electron Gas (HEG), Density Functional Theory (DFT). 

1. Introduction and Motivation 

Equilibrium statistical mechanics provides the fundamental basis for the thermodynam¬ 
ics of a given system in terms of its Hamiltonian and the characteristics of its environment 
(e.g., open or closed) |T]. The Canonical ensemble applies when the system is in contact 
with a thermal reservoir, exchanging energy at constant volume and particle number. 
It is parameterized by the temperature (T = l/fcs/3), number density (n = N/V), and 
volume {V). The fundamental thermodynamic potential associated with this ensemble 
is the Helmholtz free energy per particle fc{/3,n, V). The Grand Canonical ensemble 
applies under the same thermodynamic conditions but with the additional exchange of 
particle number with its environment. It is parameterized by /5,/i, and V, where /i is 
the chemical potential. Its thermodynamic potential is the pressure pc {P, How¬ 

ever, the free energy per particle in the Grand Canonical ensemble fG{P,nG,V) can be 
determined from pg {(3, p,V) by a change of variables p ^ ug = Opg/ dp via a Legendre 
transform (see below). Here ug is the average density in the Grand Canonical ensem¬ 
ble. Similarly, the pressure can be dehned for the Canonical ensemble by the change of 
variables n —)■ pc = —dfG/dn and a corresponding Legendre transform. 

For large systems it is expected on physical grounds that the system becomes extensive, 
in which case the free energy per particle and pressure become independent of the volume 

fc{/3,n,V) ^ fc{(3,n), pg {(3, p,V) ^ pg {/3, p). (1) 

Furthermore, if the two ensembles have the same /3, V, and p is chosen such that n = 
nG{(3,p) then the thermodynamics from the two ensembles should be equivalent in this 
limit, e.g. 

fc {/3, n) = Jg (/3, Ug) ■ (2) 

It is this equivalence that allows one to choose an equilibrium ensemble for convenience 
of computation or simulation, rather than to £t the actual experimental conditions of 
interest. For example, most formulations of density functional theory are based in the 
Grand Canonical ensemble while actual implementations in simulation are for conditions 
of the Canonical ensemble, specihcally for hxed density and volume. This raises the chal¬ 
lenge of quantifying the conditions for the validity of ([T]) and ([2]), and hnding relationships 
between properties in different ensembles. The objective here is to formulate this prob¬ 
lem more precisely and to provide some answers for the simplest case of a non-interacting 
Fermi gas. 

The large system limit is dehned by H —)■ oo at constant n or ug for the Canonical and 
Grand Canonical ensembles, respectively. Equivalently, this can be stated as —)■ oo 
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at constant n, or Nq —>■ cxo at constant no- In detail, the shape of the system must 
be constrained as well, e.g. all dimensions should be of comparable size L such that 
L/ro is large, where vq is the average inter-particle spacing dehned by Airnr^/S = 1 . 
The desired limit requires that L be large compared to all other characteristic length 
scales as well. One of these is the force range of interaction, a. For Coulomb systems 
this is replaced by the screening length. Another length scale is the thermal de Broglie 
wavelength A which becomes large at low temperatures, or the corresponding Fermi length 
A at temperatures near zero. There can also be a scale set by the spatial variations of 
an external potential. Finally, the correlation length is typically of the order of the force 
range, but becomes large near a critical point so that system-size dependence can be 
important even for macroscopic systems. In cases for which L is not the dominant 
length scale the system is “small” and, while the thermodynamic formalism is universal, 
the details must account for the specihc environment of the system being described |2]. 
Here only the Canonical and Grand Canonical conditions are considered, although many 
other ensembles for other environments are of experimental interest m- There is a large 
literature on the asymptotic evaluation of the difference between properties calculated in 
different ensembles, e.g., fluctuations in extensive variables |3]. Much less is known away 
from such asymptotic conditions. However, low temperature thermodynamic properties of 
interacting fermions in 1-D system have also been discussed in the literature (see Ref. m)- 

The next section dehnes the ensembles and their associated thermodynamic potentials. 
In particular, for comparisons exact relationships between them are identihed for arbitrary 
system size. Generally, the thermodynamic properties for the two cases are not equal. 
However, in section |3] an asymptotic analysis for one of these relationships shows their 
equivalence for large V (or large N) at constant number density. The analysis is formal 
and does not expose the full dependence on V nor the cross over to the extensive limit 
in (II]). A more detailed quantitative evaluation is provided in section 0] for the special 
case of a homogeneous non-interacting gas. In that case, the only relevant length scales 
are tq and A (or A). Finally, inhomogeneous non-interacting systems with an external 
potential are discussed in section 0] and related to the results of section 0] using a local 
density approximation (see below). The relevance for ensemble dependence and system- 
size corrections to the familiar Thomas-Fermi approximation in density functional theory 
[5] is discussed. 

2. Canonical and Grand Canonical Ensembles and Their Thermodynamics 

The equilibrium Canonical ensemble for a system of N particles in a volume R, coor¬ 
dinates qi, with pairwise interactions and an external single particle potential is dehned 
by the probability density operator 

Pc = (5fc = -^InTr^e-^^^. (3) 

Here, Hj^ is the Hamiltonian operator for N particles 

N 

Hn = A'at -I- + '^v (qi), 

^=1 


( 4 ) 
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where K and $ are the total kinetic and potential energies, respectively. The specihc 
forms of the pair potential 0 (q*, qj) and external potential v (q*) are not required at this 
point. The equilibrium thermodynamics for this system is dehned from the free energy 
per particle fci/3,n,V) which is a function of the temperature T = the density 

n = N/V, and the volume V. The trace in the dehnition of fc is taken over the N 
particle Hilbert space with the appropriate symmetrization (Bosons or Fermions). For 
large systems (i.e., H —)■ cxd at hxed hnite n) it is expected that fc{(3,n,V) becomes 
independent of V. 

The corresponding Grand Canonical ensemble is dehned by the operator 

OD 

Pc = = In g Trjv (5) 

N=0 

The thermodynamics now is dehned from the pressure where the density 

dependence of the Canonical ensemble is replaced by a dependence on the chemical po¬ 
tential [ 1 . For large systems (i.e., H —)■ cxd at hxed hnite /i) it is expected that the pressure 
becomes independent of V. 

Although the pressure is the fundamentally dehned thermodynamic potential in the 
Grand Canonical ensemble, the corresponding free energy, fcW, no, V), is dehned in terms 
of that pressure by a change of variables from p to no using the Legendre transformation 


fcnc = -PG + pnG- 


( 6 ) 


Here the average number density, nG{/3,p, V), is 


nG{/3,p,V) 


dpG{/3,p, V) 
dp 


(7) 


Similarly, although the free energy is the fundamental potential in the Canonical ensemble, 
the pressure pc (/9, pc, V) is dehned in terms of that free energy by a change of variables 
from n to pg using the Legendre transformation 


Pg = - fen + Pen, 


( 8 ) 


where the chemical potential in the Canonical ensemble is 


Pcil^^n, V) 


dfc{/3,n, V) 
On 


(9) 


From the forgoing dehnitions it is seen that the thermodynamics dehned by the two 
ensembles are related exactly by the relation 


OO 

g/3pG(/3,M,V)V ^ ^ g/3/.Vg-/3/c(/3,n,V)V 
V=0 


( 10 ) 


The volume is the same for each term in this summation, so the density n changes ac¬ 
cordingly. The inversion of this relationship is obtained in the Appendix: 

g-/3/c(/9,n,y)iV ^ ^ ^QYeN^/3pGW,^l=-i0//3,V)V 

2n Jo 
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Note that the Grand Canonical pressure must be analytically extended to complex values 
of the chemical potential. 

As noted above, the determination of Canonical ensemble properties from given Grand 
Canonical ensemble results is relevant for practical applications of density functional the¬ 
ory. The inversion of ffT0|) has been discussed recently [6] where it is proposed to construct 
fc{(3,n,V) from a set of linear equations obtained from evaluation of at ^ 

discrete values of /i. In principle, this requires M —>■ oo but approximate values for 
fc{/3,n, V) are obtained for hnite M. More systematic expansions are described in refer¬ 
ences m- This latter work has been generalized by Lutsko [9]. Equation (1TT|1 appears 
to be new. A similar complex expression is given in reference [3], section 3.2, but under 
the assumption that the discrete summation over N in ffTOj) can be replaced by an inte¬ 
gration. In that case it becomes a Laplace transform for which the complex Bromwich 
integral provides its inversion. The explicit construction of flTTl) for the actual discrete 
case is given in Appendix A. 

3. Thermodynamic Equivalence for Large Systems 

In this section the limit of large systems is considered. For it the Canonical and 
Grand Canonical thermodynamics are expected to be equivalent. For the Canonical 
ensemble large systems means the limit N ^ oo at constant hnite density n = N/V and 
temperature. For the Grand Canonical ensemble this limit is C —)■ oo at constant chemical 
potential p and temperature. To show this equivalence consider again flTTD written as 

/3/c(/3, n, V)N = - In — / (12) 

27 r Jo 

where now A{z) is a real function of the complex variable 2 ;, 

A{z) = izn + l3pG{l3,-iz/l3,V). (13) 

It has a stationary saddle point at the value z = Zg dehned by dA/dz = 0. Using ([7j) this 
is 


RenG(/5, -izg/ld, V) = n, Imnd/d, -iZs/(3, V) = 0. (14) 

Since nd/d, z, V) is a real function of z the solution is Zg = ifdps with real pg determined 
from 

nG{f3,pg,V) = n. (15) 

Now let C denote a closed contour in the 2 ; plane including the interval [0, 27r] along 
the positive real axis and passing through i/dps on the complex axis. Assume that A{z) 
is analytic on and within C, so that the integral of exp{VA{z)) over the entire contour 
must vanish. Consequently, the integral of flT^ can be replaced by an integration over 
that part of C complementary to the interval [0, 27r]. Denoting that part by C 

l3fd/d,n,V)N = f dze^^^^\ 

Zir Jc 


( 16 ) 
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where by definition C passes throngh the stationary point fig tangent to the complex axis. 
Since A{z) is multiplied by V, the contribution near i(3fis gives the dominant contribution 
for large system size. The usual saddle-point analysis then leads to the asymptotic result 

/3fc{/3,n,V)N ^ -A{fis)V-\n^ r 

Ztt J—oo 

= -fig/3N + PpG{/3,fis,V)V + 0{\nN) (17) 

The first two terms are proportional to the free energy of the Grand ensemble evaluated 
at the value of the chemical potential that ensures Ng{(3,Ps-i V) = N. The free energies 
are therefore the same up to small corrections of the order (IniV) /N 

fcW, n, V) = /g(/3, ug, V) + 0{^ In N) (18) 

This is the expected equivalence for large systems. Note, however, that the analysis does 
not show that the free energy per particle is independent of V. That question is explored 
in more detail in the next two sections. 


4. Non-interacting, Homogeneous Systems at Finite System Size 


In this section the thermodynamics for the Grand Ganonical and Ganonical ensembles 
are calculated exactly at arbitrary system size for the simplest case of non-interacting 
particles without external potential. The Hamiltonian for N particles is 


N 


h%=j: 


i=l 


2m 


(19) 


For the Ganonical ensemble the particle number and volume are fixed so the boundary 
conditions chosen here are a cubic box of sides L with hard walls. Then the momentum 
components have eigenvalues 

ttTi 

Pa = ^ka, a = x,y,z (20) 

where ka is a positive integer. The Grand Ganonical ensemble represents an open system 
without fixed particle number. However, its derivation represents this as the sum of 
probabilities for closed systems at the same volume but different particle number. Hence 
the same boundary conditions can be used for calculation of components of each N within 
the ensemble. 


4.1. Grand Canonical Ensemble 

The pressure in the Grand Ganonical Ensemble is given by ([5]). Since Hn is the sum of 
single-particle operators the summation and trace can be performed directly in occupation 
number representation with the result for spin 1/2 Fermions [10] 

2 


^Pg = y In (l + (<) 


( 21 ) 


The three-fold summation is over k = fej,, Use has been made of 


R^ = l- 

2m 2m I L , 


= u 


TT 


2 


( 22 ) 
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where A = (27r^ is the thermal de Broglie wavelength. Similarly, the average 
number density nQ is 

= + P3) 

k 

It is tempting at this point to represent the summations over k as integrals, i.e. 
Y,F(kii) = tY. AxF [x) ^ i f dxF (x) (24) 

kx X 


Indeed this replacement leads to the familiar textbook results in terms of Fermi integrals. 
However, Ax = Akxji = 1/^ is small only for Lj\ >> 1. This is not the case for low 
temperatures or small system sizes. Hence for the purposes here the discrete summation 
must be evaluated directly. 

At this point all properties will be given a corresponding dimensionless form. The 
dimensionless temperature t is 


t = 


fdep' 




2/3 


where is the Fermi energy. It follows that 


ncX^ = 


-t 


- 3/2 


3\/? 

so that (123|1 becomes 
6 


^- 3/2 ^ 








+ l) , 


and 




1/3 


An appropriate dimensionless pressure is 
(3pG 2 — / - 


Ph (*. No) = 


no No y 




(25) 

(26) 

(27) 

(28) 

(29) 


Here it is understood that — (i/r (t, No) as determined from (I27l> . Finally, the dimen- 

sionless free energy per particle is obtained from the Legendre transformation as described 
in (6). 


/S ((, No) = -ph (t, No) + /3/a ((, No). 


(30) 


The dimensionless system-size parameter is now Nq- The analysis proceeds as follows: 
1) choose a value for Nq and calculate jSp (t, Nq) as a function of t from fl27)) . Repeat for 
different values of Nq- The results are shown in Figure 1(a). Also shown is the limiting 
value for Nq —)• oo obtained from the continuum limit (i.e., fl2T)) i: 2) Calculate Pq (t, Nq) 
from fl2^ as a function of t for the same set of values for Nq- The results are shown in 





Figure 1(b); 3) Calculate the dimensionless free energy (t, as a function of t for 
the same set of Nq from fl30l) . The results are shown in Figure 2. 

These hgures show that the system-size dependence is small for Ng > 16 at f = 10, but 
is more signihcant as the temperature is lowered. This is expected since that dependence 

is controlled by £ = and vanishes only for large i. Below t = 1, larger values 

of Ng are required to approach system-size independence. 



Figure 1. (a) Plot of /3^ (t, Ng) as a function of the dimensionless temperature t for several 
values of Ng = N. Also shown is the large system-size limit, (b) Plot of the dimensionless 
pressure Pg (t, Ng) as a function of the dimensionless temperature t for several values of 
Ng = N. 


4.2. Canonical Ensemble 

Equation fllip shows that the Canonical ensemble free energy per particle can be ob¬ 
tained from the Grand Canonical pressure, extended to complex values for the chemical 
potential. It is written as 

1 1 /*27r 

flfcW,n,V) = --ln— (31) 

iV 27 r Jo 

with 


ro ^ An - = -iO/^,V) 

g [U, t,I\) = - 

n 





(32) 


The dehnitions of t and ^ are the same as in fl2^ and (1281) except with ug and Ng replaced 
by n and N. The calculation of g {9, t, N) is similar to that of Pq (t, Ng) in (12^ . except 
that it has both real and imaginary parts. Their numerical calculation is straightforward 
but the final 6 integration of fl3ip is now problematical. Due to the complex integral 
it has an oscillatory integrand whose variation increases as N, and whose modulation 
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Figure 2. Plot of the dimensionless free energy per particle, (t, Nq) = Pfc {/3, no, V), 
as a function of the dimensionless temperature t for several values of Ng = N. 


varies between values of the order exp(±A^). Figure 3 illustrates the problem for N = 64, 
t = 0.63. This is a precursor for the cross-over to the asymptotic analysis of section 
[31 The hrst difficulty of a rapidly oscillating integrand can be overcome by increasing 
the density of mesh points. That works in principle for both very large N and t. The 
second problem of huge cancellations when the integral is evaluated numerically as a sum 
over mesh points does not have a simple solution because of the hnite precision of floating 
point numbers. As can be seen from the hgure 3 the highest magnitude of the integrand is 
~ 10® while the hnal value of the real part of the integral is ~ 10“^®. Quadruple precision 
is required for adequate accuracy within the restricted domain 0.1 < t < 10 and N < 64. 

Figures 4a - Ad show the dimensionless Canonical ensemble free energy per particle in 
comparison with the corresponding Grand Canonical ensemble results of the last section. 
Generally, for > 16 there is good agreement between the results of the two ensembles, 
although signihcant system-size dependence relative to the large system-size limit remains. 
At smaller values of N the discrepancies between the two ensembles decreases at lower t. 
On the contrary, the difference for both ensemble from the large system limit increases 
with smaller N and t. 

For t = 0 the free energy for both Canonical and Grand Canonical ensemble are the 
same for given N as it is the sum of discrete energies upto the Fermi energy for N particles. 
This, however, is still different from the inhnite system limit which is an integral over the 
density of states. 
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Figure 3. Illustration of the strong variation with 6 for the integrand of fl3Tl) . for N = 64, 
t = 0.63 


5. Relationship to Density Functional Theory 

Density functional theory (DFT) describes the thermodynamics of an equilibrium, in¬ 
homogeneous system whose Hamiltonian has the form (jl]) [5]. The external potential 
implies that the local density is non-uniform. DFT has a variational principle that states 
that the thermodynamic properties are obtained from a functional of this density at its 
extremum. The dehnition of the functional can be given as follows. First, the Grand 
Canonical ensemble pressure and density are computed as functionals of the external 
potential as in (|5]) 

,3PgV' = In yrr;, „c(r) ^(33) 

(r) 

Next, the external potential is eliminated by inverting the second equation to give f^pcV 
as a functional of the density and hnally, the density functional of DFT is then given by 

0 

Fdft = -PgV + J dr{fi-v{r)) no (r) , (34) 

It is understood that the density and external potential in the second term are now in¬ 
dependent functions. They become related by the extremum condition that provides the 
equilibrium density in terms of the external potential. Finally, with that relationship es¬ 
tablished, evaluation of Fdft at its extremum gives the Legendre transform ([6]) (extended 
to the inhomogeneous case) and hence the equilibrium Grand Canonical free energy. 

It is clear from this brief description of DFT that its theoretical formulation is tied to 
the Grand Canonical ensemble. However, in practice construction of approximate func¬ 
tionals often presumes the large system-size limit (e.g., Thomas-Fermi and local density 
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(a) 



(b) 




Figure 4. Panel (a) compares the dimensionless free energy per particle for Canonical 
and Grand Canonical ensemble (/^ {t, Nq) , {t, N) as a function of the dimensionless 

temperature t for N = 2. Also shown is the large system-size limit. Panels (b)-(d) show 
the same comparison for = 8, = 16 and A^ = 64 respectively. 
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approximations). Calculations almost always fix the total number of particles, N, as in 
the Canonical ensemble. Consequently, system-size corrections and ensemble dependen¬ 
cies are overlooked or ignored. The analysis of the previous sections is therefore quite 
relevant for current problems of DFT. 

To illustrate this, consider the non-interacting part of the DFT functional constructed 
as above 


l3p'cV 


dr (r 


In 




1 + 


(35) 


n, 


( 0 ) _ 


GC' 


r) = 




(36) 


=-fdr(r 


In -1- 

fdr/3 (/r-u(r))ug^(r). 


(37) 


On the right side of (15B]) u(°)(q | n^^) denotes the inversion of (I5BD to obtain v (r) as a 
functional of n^^(r). Further construction of (dF^pj, is non-trivial for general external 
potential and entails diagonalization of the single particle Hamiltonian p^/2m-|-u(q) and 
self-consistent inversion of the expression for ?7,g^(r) (the Kohn-Sham approach) [TTIIT^ . A 
simpler method is the local density approximation that replaces the operator dependence 
of the external potential by its value at the point of interest, (u(q)) —)■ u(r)). Then for 
instance the density equation can be evaluated in momentum representation using the 
same boundary conditions as above 

«Gkr) ^ f E + l)”' \Mr)\^ (38) 

In the large system-size limit the summation can be represented as an integration and 
becomes the familiar hnite temperature Thomas-Fermi approximation 

nPp{r) ^ h-^ J dp ^ 

Equations fl38|l and fl3^ are the same results as for the homogenous system analysis of the 
last section, with only the replacement /i —>■ /r — v{r). Hence the system-size corrections 
found there for small N, t apply here as well, and those corrections for the free energy per 
particle identihed in Figure 2 and 4(a)-4(d) are required for the DFT functional as well. 
Notwithstanding those corrections, it is expected that differences between the results for 
the two ensembles are small for N = Ng > 16. Further discussion of system-size and 
ensemble dependence of the DFT functional will be given elsewhere. 
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A. Appendices 

A.l. Determination of fc{(3,n,V) from. pg{(3, fi,V) 

The definition of fc{l3,n, V) in ([3]) can be written in the equivalent form 

1 1 °° 

/3fc = --In Tr^ In E , (40) 

with a representation for the Kronecker delta to get 
1 1 l•2n oo 

/3fc{/3,n,V) = -^In— / 

N 27r Jo 

1 1 r2n 

= -±\n— 

N 2tt Jo 

The last line follows from the definition of pc in (E]). This gives the relationship flTTll 
quoted in the text 

1 n 27J" 

-^fc(fi,n,V)N iON PpG{P,fi=-iB/liy)V (^ 2 ) 

271 Jo ■ ^ ^ 

The consistency of this result with its inverse (ITOll can be demonstrated by substituting 
the latter into the right side of (1TT|1 


g-/3/c(/3,n,V)7V 


1 


M=0 



^Q^ie{N-M)^-l3fc{l3,n=M/Vy)M 


^-l3fcW,ny)N 


(43) 
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